Papers with normalization techniques
A Large-Scale Comparison of Historical Text Normalization Systems (N19-1)
Copied to clipboard
| Challenge: | a large study of historical text normalization is done on eight languages . there is no consensus on the state-of-the-art approach to normalization . |
| Approach: | They present a large study of historical text normalization done on eight languages . they evaluate four different systems based on supervised learning on datasets from eight different languages based in the literature . |
| Outcome: | The proposed methods are based on supervised learning and are available online. |
RealVul: Can We Detect Vulnerabilities in Web Applications with LLM? (2024.emnlp-main)
Copied to clipboard
| Challenge: | a lack of research specifically focused on vulnerabilities in the PHP language hinders the model’s ability to effectively capture the characteristics of specific vulnerabilities. |
| Approach: | They propose a framework that can isolate potential vulnerability triggers while streamlining code and eliminating unnecessary semantic information. |
| Outcome: | The proposed framework can isolate potential vulnerability triggers while streamlining the code and eliminating unnecessary semantic information. |
Machine Translation of Low-Resource Spoken Dialects: Strategies for Normalizing Swiss German (L18-1)
Copied to clipboard
| Challenge: | Using character-based neural MT, we normalize Swiss German input to address regional diversity. |
| Approach: | They propose to use character-based neural MT to normalize Swiss German input and phrase-based statistical MT for a low-resource family of dialects. |
| Outcome: | The proposed system achieves 36% BLEU score when translating from the Bernese dialect. |